Stochastic Abstract Policies for Knowledge Transfer in Robotic Navigation Tasks

نویسندگان

  • Tiago Matos
  • Yannick Plaino Bergamo
  • Valdinei Freire da Silva
  • Anna Helena Reali Costa
چکیده

Most work in navigation approaches for mobile robots does not take into account existing solutions to similar problems when learning a policy to solve a new problem, and consequently solves the current navigation problem from scratch. In this article we investigate a knowledge transfer technique that enables the use of a previously know policy from one or more related source tasks in a new task. Here we represent the knowledge learned as a stochastic abstract policy, which can be induced from a training set given by a set of navigation examples of state-action sequences executed successfully by a robot to achieve a specific goal in a given environment. We propose both a probabilistic and a nondeterministic abstract policy, in order to preserve the occurrence of all actions identified in the inductive process. Experiments carried out attest to the effectiveness and efficiency of our proposal.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Reusing Risk-Aware Stochastic Abstract Policies in Robotic Navigation Learning

In this paper we improve learning performance of a riskaware robot facing navigation tasks by employing transfer learning; that is, we use information from a previously solved task to accelerate learning in a new task. To do so, we transfer risk-aware memoryless stochastic abstract policies into a new task. We show how to incorporate riskawareness into robotic navigation tasks, in particular wh...

متن کامل

Speeding-up reinforcement learning through abstraction and transfer learning

We are interested in the following general question: is it possible to abstract knowledge that is generated while learning the solution of a problem, so that this abstraction can accelerate the learning process? Moreover, is it possible to transfer and reuse the acquired abstract knowledge to accelerate the learning process for future similar tasks? We propose a framework for conducting simulta...

متن کامل

Efficient State Spaces and Policy Transfer for Robot Navigation

Autonomous mobile robots are critical in many real world applications, ranging from planetary exploration to search and rescue. Indeed, the application domains using such robots are steadily increasing, and as the robots get smaller, navigation policies that operate with reduced computational and memory requirements become critical. In addition, as tasks become more complex, directly developing...

متن کامل

Generalization and Transfer Learning in Noise-Affected Robot Navigation Tasks

When a robot learns to solve a goal-directed navigation task with reinforcement learning, the acquired strategy can usually exclusively be applied to the task that has been learned. Knowledge transfer to other tasks and environments is a great challenge, and the transfer learning ability crucially depends on the chosen state space representation. This work shows how an agent-centered qualitativ...

متن کامل

Structural Knowledge Transfer by Spatial Abstraction for Learning Agents

In this article we investigate the role of abstraction principles for knowledge transfer in agent control learning tasks. We analyze abstraction from a formal point of view and characterize three distinct facets: aspectualization, coarsening, and conceptual classification. The taxonomy we develop allows us to interrelate existing approaches to abstraction, leading to a code of practice for desi...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011